HOMOCLINIC POINTS FOR AREA-PRESERVING SURFACE 
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Abstract. We show a C connecting lemma for area-preserving surface dif- 
feomorphisms and for periodic Hamiltonian on surfaces. We prove that for 
a generic , r = 1,2,..., oo, area-preserving diffeomorphism on a compact 
orientable surface, homotopic to identity, every hyperboHc periodic point has 
a transversal homoclinic point. We also show that for a C", r = 1, 2, . . ., oo 
generic time periodic Hamiltonian vector field in a compact orientable surface, 
every hyperbolic periodic trajectory has a transversal homoclinic point. The 
proof explores the special properties of diffeomorphisms that are generated by 
Hamiltonian flows. 



1. Introduction and statement of main results 

Let M'^" be a compact 2n dimensional symplectic manifold with a symplectic 
form Lu and let Diff^(M) be the set of all C", r = 1, 2, • • ■ , oo, diffeomorphisms that 
preserves the symplectic form cu. For / G Diff^(M), a point p E M is said to be 
a periodic point of / with period k if f^{p) — p. A periodic point p is said to be 
hyperbolic if all the eigenvalues of df'^{p) are away from the unit circle. For any 
hyperbolic periodic point, there stable manifold, where points approaches p under 
forward iterations of f'^, and a unstable manifold, where points approaches p under 
backward iterations of f'^. For symplectic diffeomorphisms, both the stable and 
unstable manifolds are n dimensional. We write the stable and unstable manifold 
of p as, respectively, Wj{p) and W^{p). 

A point q G M is said to be a homoclinic point to a hyperbolic periodic point 
p ii q G {W''{p) n W^{p))\{p}. i.e., homoclinic points are nontrivial intersections 
of stable and unstable manifolds. A homoclinic point q is said to be transversal if 
W^{p) intersects W^{p) transversally at q. 

Transversal homoclinic points are responsible for very complicated and chaotic 
dynamics. Poincare discovered the homoclinic phenomenon and its associated 
chaotic dynamics in his study of the restricted three body problem in celestial 
mechanics ,13^. Poincare conjectured that transversal homoclinic points occurs 
generically in Hamiltonian systems. Proving the generic existence of homoclinic 
points to a hyperbolic periodic trajectory is a classical problem in Hamiltonian 
dynamics. Our main result in this paper positively answers Poincare's question for 
lower dimensional Hamiltonian systems. 

Our first result is on area-preserving diffeomorphisms on compact surfaces that 
are homotopic to identity. Recall that a subset is said to be residual if it contains 
a countable intersection of open and dense subset. A property is said to be generic 
if it holds on a residual set. 
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Theorem 1.1. Let M be a compact orientable surface and let Diff^ o(-^^) 
of all C difjeomorphisms on M preserving an area form uj on M and isotropic to 
identity. Then for any r = 1, 2, . . . , oo, there is a residual subset Ri C Difl^ o(-^^) 
such that if f ^ Ri and p is a hyperbolic periodic point, then 

w'ip)nW{p)\{p}^9 

Our result naturally applies to Hamiltonian systems. Again let M^" be a sym- 
plectic manifold with the symplectic form cu. The nondegenerate closed two-form uj 
on M^" defines an isomorphism between the tangent bundle and the cotangent bun- 
dle of M with J : T*M — > TM, where the isomorphism J is uniquely determined 
by the following equality: Jo) = a{*) for any one-form a. 

Let H : M^" ^ R be a real valued function. JdH defines a C vector field 
on M. This vector field is call a Hamiltonian vector field and the function H is called 
a Hamiltonian function, or Hamiltonian. The Hamiltonian is a constant of motion 
under the Hamiltonian flow. A periodic trajectory, also called closed trajectory 
is said to be hyperbolic is all its characteristic multipliers are away from the unit 
circle, except two. The characteristic multipliers are one in the flow direction and in 
the normal direction of the Hamiltonian function. The stable manifold and unstable 
manifold of a hyperbolic closed trajectory both have dimension n. 

We will consider time dependent Hamiltonian systems, where the Hamiltonian 
function can be written as H = H{x,t), with x € M and t e R. The resulting 
Hamiltonian vector field is no longer autonomous. We are particularly interested 
in time periodic Hamiltonian systems where there is a positive real number T such 
that H{x,t + T) = H{x,t) for all x G M and t G R. Time periodic Hamiltonians 
define Hamiltonian flow on M x 5'"'^. Time periodic Hamiltonian can be reduced to 
a symplectic diffeomorphisms on M by considering its Poincare map. Hyperbolic 
periodic points and their stable and unstable manifold can be defined in the same 
way as those of symplectic diffeomorphisms. 

We can now state our theorem for the Hamiltonian case. 

Theorem 1.2. Let M be a compact orientable surface with an area form lo. For 
any r = 1,2,..., oo, there is a residual subset i?2 C C""^^(M x S^) such that if 
e i?2 o,nd J is a hyperbolic periodic orbit for the time periodic Hamiltonian 
vector field JdH{x,t), then 

W^(7)nVF"(7)\{7}^0. 

Related to the existence of homoclinic points in the Hamiltonian systems and 
symplectic diffeomorphisms is the so called the closing lemma, also raised by Poincare 
in the same time. Poincare believed that the periodic points are dense in a 
typical Hamiltonian system on compact manifolds. For generic diffeomorphisms 
(C^ generic Hamiltonian systems), the closing lemma was proved by Pugh ^1] and 
Pugh and Robinson A different proof was given by Liao The proof uses 
local perturbation methods. However, the C" closing lemma for arbitrary r remains 
open except for some very special cases (Anosov ^ for Anosov diffeomorphisms, 
Pesin for non-uniformly hyperbolic diffeomorphisms, Xia and Zhang ^2,^ for 
some special cases of partially hyperbolic diffeomorphisms) . Franks and Le Calvez 



HOMOCLINIC POINT 



3 



0, Xia [211 provided some further evidence supporting C' closing lemma for area- 
preserving surface diffeomorphisms. 

Proving the existence of homoclinic points, or connecting stable and unstable 
manifolds, is also know as a connecting lemma. Takens |17| proved that gener- 
ically every hyperbolic periodic points has a transversal homoclinic point for sym- 
plectic and volume-preserving diffeomorphisms. Takens results were extended by 
Xia [2n|, using closing lemma types of techniques of Hayashi. Hayashi established 
the first connecting lemma for hyperbolic invariant set of general diffeomorphisms 
(Hayashi A general version of connecting lemma was obtained by Wen and 
Xia JSI dl' We remark that he method for all these results are local pertur- 
bation methods and they are definitely restricted to topology (cf. Gutierrrez 

El) , 

The C" connecting lemma for r > 1 is a much more difficult problem. Using 
the idea of "closing gates" , Robinson |16] , following an idea of Newhouse, showed 
that one can connect the stable and the unstable manifolds of a hyperbolic fixed 
point on two sphere by a C small perturbation, if the stable manifold accumulates 
on the unstable manifold. The accumulation condition is a generic condition for 
area-preserving diffeomorphisms. Pixton 12^ extended Robinson's result to hyper- 
bolic periodic points on two sphere. Using a more topological approach, Oliveira 
[3] showed the C generic existence of homoclinic points for area-preserving dif- 
feomorphisms on two torus T^. More recently, Oliveira Tn* showed the generic 
existence of homoclinic points on surfaces of higher genus for certain homotopic 
classes of area-preserving diffeomorphisms, where the actions on first homology, if 
complicated enough, simply forces intersections of stable and unstable manifolds. 
His result does not apply to the important cases, including Hamiltonians, where 
the action on homology is trivial. 

To obtain our results, we explore the special properties of the Hamiltonian flow 
and Hamiltonian diffeomorphisms. Our result uses the concept of flux, a dual 
concept to the mean rotation vectors, for area preserving diffeomorphisms that are 
homotopic to identity. We show that the maps with rational flux has certain special 
properties. These special properties enable us to show the existence of homoclinic 
points. 

We are motivated by the Arnold conjecture for Hamiltonian diffeomorphisms on 
compact surfaces. Hamiltonian diffeomorphisms arc the ones generated by time pe- 
riodic Hamiltonian flow. The number of fixed points for these diffeomorphisms are 
larger than what is predicted by the Lefschitz fixed point theorem, as Arnold con- 
jectured and later proved in this case by Floer 2 . Likewise, we show that typically 
the stable and unstable manifolds for hyperbolic fixed point do intersect. We re- 
mark that there are easy examples of non-Hamiltonian diffeomorphisms with stable 
manifold and unstable manifold accumulating on each other, but never intersecting. 

Combining with generic existence of hyperbolic periodic points for area-preserving 
surface diffeomorphisms (cf. Xia f^), we have the following corollary. 

Corollary 1.3. For r — 1,2, ... , oo, an open and dense set of time periodic 

Hamiltonian systems on compact surfaces have positive topological entropy. 

Similar statement is true for area-preserving diffeomorphisms in Diff^ o(-^^)- 
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2. Flux and mean rotation numbers 



Let Mg, 5 > 1, be the orientable compact surface of gcmis g and let {ai,bi), 
i = l,2,...,fc, be the canonical generators of its first homology iJi(Mg,M) and 
let (ai,/3j), i = l,2,...,k, be the dual basis for the first De Rham-cohomology 
H^{Mg, R). By normalize the area form u on Mg, we may assume that 



Wc consider the cases where / is homotopic to the identity map. Let I be an 
oriented closed curve in M = Mg, since / is isotopic to identity, there is a oriented 
disk D c M such that the boundary dD = f{l) — I. We define the flux of / across 
I to be 



Where ji is the area element given by the two form u. The above quantity is 
independent of the choice of D. If D' is another disk such that dD' = f{l) — I, then 
d{D — D') = dD — dD' = 0. Since M is two dimensional, the boundaryless disk 
D — D' \s either the whole manifold or the empty set. Therefore Jj^ = Jj^, djjb 
mod 1. We remark that one can always choose D' = —{M\D), therefore the flux 
can only be defined up to mod 1. 

In fact, the fiux Ff{l) depends only on the homology class of I. i.e., if I' is 
homologous to I, then Ff{l') = Ff{l). This is because that there will be is a disk 
Ac M such that dA ^l~l'. Let D and D' be the disks such that dD = f{l)-l and 
dD' = /(/') - I', then df{A) = f{dA) = f{l) - f{l') and dD - dD' = df{A) - dA, 
therefore, D — D' = f{A) — A. Consequently, d^i — j^, d^i = /^(•^■j dfx — d/.i = 0. 

The fiux Ff defined above can be extended to a linear map on the first homology 



and thus it can be represented by a cohomology vector. 

The fiux has a nice additive property under the iterations of the map /. One 
easily verifies that Ffk{l) = kFf{l), mod 1, for all integers k and for all closed 
curves /. 

The flux is closely related to the mean rotation vector of /. Let / G Diff[, q{M) 
be a area-preserving map homotopic to identity and let Fg : M ^ M , s G [0, 1] be 
the homotopy: Fq = Mm, the identity map on M, and Fi = f. Let Fs be a lift of 
Fg in the universal covering space M of M. Let a be a differential one- form on M. 
To simplify the notation, wc also use a to denote its pull-back on M. Let Mq be a 
fundamental domain in M and let 



The function R{a) is linear on a. One can easily show that, when a is exact, 
R{a) is zero. Therefore R{a) induces a linear map on the first cohomology of M, 
i?^(M, R). This gives a homology vector in i?i(M, R). This homology vector is 
called the mean rotation vector. A different lift of Fg will give a different mean 
rotation vector R{a), but the difference is an integer. 

We remark that the flux is more intuitive than the mean rotation vector and it 
can be easily extended to the some cases where the map is not isotopic to identity. 





Ff : Hx{M) -^M. modi. 




HOMOCLINIC POINT 



5 



For example, if a closed curve is homologous to its image, then then flux across this 
closed curve can be defined in the same way. 

Let V/ = {Ff{ai),Ff{bi),Ff{a2),Ffib2),...,Ff{ag),Ff{bg)) be the vector in 
T^^. We call Vf the flux vector. 

Let / e Diff^(M) be a map with a rational flux vector, where all its components 
are rational numbers. Then there exists an integer k such that has zero as 
its flux vector. We will show that any map can be approximated by a map with 
rational flux vector. Later in the paper, we will discuss special properties of maps 
with zero flux vector. 

It is a easy exercise to show that if a map is isotopic to identity and has flux 
zero, then its mean rotation vector is zero, modulus Z". 

As we will see later, all maps defined by Hamiltonian flows have zero flux. 

3. Basic perturbations and some generic properties 

In this section, we will do a sequence of initial perturbations so that the dif- 
feomorphisms we consider satisfy certain properties. These properties will later 
guarantee the existence of homoclinic points for every hyperbolic periodic point. 

Our first perturbation is to change the flux vector of the maps that are homotopic 
to identity. We will show that the maps with rational flux vector form a dense subset 
in Difl^(M). 

Lemma 3.1. Let f G Difi^(M) be a area preserving diffeomorphism, homotopic 
to identity. Then for any neighborhood V of f in Difi^(Af), there is a map g in V 
such that the flux vector Vg is rational. 

Proof. Let (a^, 5,) be the canonical generators of the first homology Hi{M, Z). For 
any i — 1,2, . . . , g, we may assume that Oi and bi are simple closed curves such that 
these curves don't intersect each other except and bi] Oi and bi intersect at only 
one point and the intersection is transversal. 

Fix i, let be a small tubular neighborhood of bi. We can parametrize this 
tubular neighborhood 5i,. by 5^. : x [—5, S] — > M for some small S > 0. In 
fact, for convenience, we can even assume, without loss of generality, that the 
parametrization Sf,. is area- preserving. 

Let (3 : [-S, S] ^Rhe a C°° function such that (3{t) > for all -S < t < S and 
(i{—5) = (3{5) — and /3 is C°° flat at ±5. i.e., all the derivatives of (3{t) at ±5 are 
zero. 

Let h^ : M ^ AM be a C°° diffeomorphism such that if z ^ Si,., h^{z) — z and 
if z e 5b,, = da, oT, o ((5a.)"^ where T,{e,t) = {0 + eP{t),t) for aU 6 e and 
t £ [—6, S]. We remark that he — *■ Mm in C"^ topology as e — > 0. 

It is easy to see that the flux of h^ across aj and bj are all zero for j ^ i and the 
flux across bi is also zero. For e > small enough, we have F^,^ (at) ^ 0. 

Since F/oh, (0 = Ff{l)+Fh, (0 ^'^^ closed curve I, we have that for sufflciently 
small e > 0, Ffoh^o-i) — Ff{ai) ^ 0. There are infinitely many choices of small e 
such that Ffohcio-i) is rational. 

We can do similar perturbations to every closed curves and bi so that the flux 
across bi and Oi are all rational. 

This proves the lemma. □ 

We now state a well-known local perturbation lemma (cf . Newhouse |H] , Robin- 
son [m, Takens ^ and Xia (HI). 
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Let d be a metric on M" induced from some Riemann structure and let Bs{x) 
denote the set of y G M" with d{x, y) < 6. We also let Bs{x) denote the closure of 
Bsix). 

Lemma 3.2. (perturbation lemma) Let M" be an n-dimensional compact manifold. 
Fix (f) S Difi^(M), r > 1. There exist constants eo > and c > 0, depending on (p, 
such that for any x G M", and any ip e Diff[,(A'/) such that \\(f) — tp\\c^ < eo; and 
any positive numbers 0<S<eQ,0<e<eo, the following facts hold. 

if d{y,x) < cS'^e, then there is a tpi G Difi^(M), \\tpi — tp\\c^ < e 
such that tpiil)~^{x) = y, tpi{z) = 'ip{z) for all z ^ 'ij)~^{Bs{x)), and 
^-i(^) = Vr^W for all z ^ Bs{x). 

The proof of this lemma uses the generating functions, which provide a conve- 
nient tool in the study of Hamiltonian systems and symplectic diffeomorphisms. 

We remark that the local perturbation provided in the perturbation lemma does 
not change the flux vector or the mean rotation vector of the map. 

Now we use the perturbation lemma to prove the following simple result: 

Lemma 3.3. Let (j) £ Difl^(M) and let p S M" be a hyperbolic periodic points of 
period k, with respect to (f). For any e > 0, any q G W^{p) and any neighborhood 
U of q, there exist a cj)' € Dif]^(M), ||^ — ^'Hc- < e such that 

(1) Support{(j) — (j)') dU and hence, p is a hyperbolic periodic point of period k 
for (p', 

(2) q€W^,{p), 

(3) q is a recurrent point under (j)' . 

Recall that a point q S M " is a recurrent point under (j)' if there exists a sequence 
of positive integers {n^}^]^, rij ^ cx) as i —> oo such that {4>')^^{q) q as i ^ oo. 

Proof Let e > be given. For any q G W^{p) and U C M", a small neighborhood 
of q, choose 6i small so that Bsi{q) C U. Consider the small ball B^ = BcS^eiiq), 
where c is given by the perturbation lemma and < ei < e/2. Since (f) Pre- 
serves the volume and M" is compact, there exists a positive integer ji such 
that (pi^{B^)f]Bs,{q) ^ and (l)'{B^)C[Bs,iq) = for ah t = 1,2,... Ji - 1. 
This implies that there exists a point qi € Bs^{q) such that 4>^^{qi) S Bs^{q) and 
4>^{qi) ^ Bs^ (q), for alH = 1, 2, . . . , ji — 1. Now we apply the perturbation lemma 
to obtain 0i G Difr^(M) with -(pWc- < ei < e/2 and Support(0-0i) C Bs^{q) 
such that (t)i{q) = (piqi). Thus {(t)i)H<i) e BsM)- 

Now, since {4>iy^ [q) ^ q, we may choose Q < 82 < 5i/2so that {(j)iy{q) ^ Bs^ (q). 
Let B^ = Bcsit^iq), where < £2 < e/4. We choose 82 and €2 so small such that 
for all (j)' G Diff^(M), with ||(/)' — ^||c?r < e2, and any point a; G S^, we have 
{<f>y'{x) G BsMXBsM and {^'y{x) i Bs,{q) for all i = 1,2 . . . , h - 1. 

With the same argument, we see that there is a point 92 G B"^ and an integer j2 > 
ii such that {(PiY^ (92) G Bs^ (q) and (<^i)^(92) ^ Bg, (g), for alH = 1, 2, . . . , j2 - 1. 
Again we apply the perturbation lemma to obtain (j>2 G Diff^(M) with \\(f)i — 
4>2\\c^ < £2 < e/4 and Support(02 — 0i) G Bg^(q) such that (/>2((?) = 4>i{Q2)- 
Observe that (hY^iq) G Bg.iq) and (^i!>2)^'"(g) G Bs^{q). 

Continue the above process, we obtain a sequence of real positive numbers Si, 
62, ■ • - , a sequence of integers < ji < j2 < • • •, and a sequence of functions (pi, 
4>2, Difi^(M) such that (0^)^'= G Bs^ {q) for all fc = 1, 2, . . . , i. 
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Let (f)' — limi^oo 4>i £ Difi^(A/), then ||0' — 0||c'- < e and q is a recurrent point 

of (f)'. 

This proves the lemma. □ 

The above lemma can also be applied to stable branches to obtain backward 
recurrent point. In fact, the proof of the above lemma yields a stronger result, 
which we will state next. For every hyperbolic periodic point on a surface, the 
stable manifold (and unstable manifold) is separated by the periodic point itself 
into two branches. We have the following lemma. 

Lemma 3.4. There is a residual subset R C Difi^(M) such that if f G R, and p is 
a hyperbolic periodic point, then every branch of stable and unstable manifolds of p 
has a forward or backward recurrent point. 

As we will prove in the next sections, rational flux vector and the existence of 
recurrent points on each branch of stable and unstable manifolds imply the existence 
of homoclinic points. 

Before we proceed, we state another lemma on accumulations of stable and 
unstable manifolds. 

Lemma 3.5. Let f C Difi^(M) be an area preserving diffeomorphism and let p be a 
hyperbolic periodic point. Let Bi and B2 be branches of stable or unstable manifolds 
of p. Bi and B2 may be the same branch. If Bi n L(i?2) 7^ 0, then Bi C i(i?2). 
Where i(i?2) *s the a-limit set of B2 if B2 is the stable branch and L[B2) is the 
Lo-limit set of B2 if B2 is the unstable branch. 

This follows from a theorem of Mather [7j . See also Oliveira fW': for a proof. 

Let p he a hyperbolic periodic point of period k for / e Diff^(M). We may 
assume, by iterating /'^ twice, that each branch of the stable or unstable manifold 
is invariant under f''. We take a linearization near p such that p is the origin and 
locally the a::-axis is unstable manifold, j/-axis is the stable manifold. We denote the 
stable and unstable branches by B^ and Bf. 

We first consider the branch of unstable manifold from the positive x-axis. Let 
q G 5+ be a recurrent point 5+. The orbit of q accumulates on {q} itself. This 
implies that the orbit of q accumulates at some point on the stable manifold of 
p. The orbit of q can accumulate the y axis in two ways: from the first quadrant 
or from the fourth quadrant, or possibly both. We may assume that it is the 
former case, the orbit of q accumulates from the first quadrant. Let i?+ be the 
branch of the stable manifold from the positive y-axis. By Lemma 13.51 we have 
that B+ C L{B+) and B+ C L{B+). 

By Lemma 13.41 there is a backward recurrent point on i?+ . The orbit of this 
recurrent point approaches accumulate on itself either from the first quadrant or 
the third quadrant. If it is the former case, then we have an adjacent pair of stable 
and unstable branches i3+ and B+, that accumulate on each other. See Figure 

We claim that there is always an adjacent pair of stable and unstable branches 
accumulate on each other. In the above case, if B^ accumulates on itself through 
the third quadrant, then we can consider the unstable branch B~ on the negative x- 
axis and the stable branch B~ on negative y-axis. Again each branch has two ways 
of accumulating on itself. Either there are two adjacent branches accumulating on 
each other, or we have a cyclic accumulation: _B+ on Bf on B~ , B~ on B~ , 
B^ and on B^ . However, by Lemma 13.51 the above accumulations are transitive. 
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would have to accumulate on and hence B^ and therefore, i?+ and Bf are 
accumulating adjacent pair. 

4. Maps with zero flux vector 

In this section, we assume that / G Diff^ q (A/) is homotopic to identity and 
V/ = 0. 

Let p be a hyperbolic periodic point of period k and let ^{p) and be, 
respectively, the stable manifold and the unstable manifold of p. For simplicity and 
without loss of generality, we choose a local coordinate around p, 

D = {{x,y)eR^ I |x| < 2AS, |2/| < 2AM 

with some A > and some small > such that p is the origin in D and f'^ is 
linear D, 

for some A > 1. Let i3„ be the branch of the unstable manifold of p containing 
the positive a;-axis and Let B^ be the branch of the stable manifold of p containing 
the positive y-axis. We further assume that Bs accumulates in _B„ from the first 
quadrant in D and Bs accumulates in _B„ from the first quadrant in D, as Figure ^ 
shows. The main result of this section is the following theorem. 




Figure 1. Accumulation of stable and unstable branch 

Theorem 4.1. Let f G Difi^ o(-^^) '^'^ area preserving dijfeomorphism. Assume 
that f is isotopic to identity and f has zero flux, — 0. Let p be a hyperbolic 
periodic points with Bs and B^ as described above. Then B^ H Bs\{p} ^ 0. i.e., 
there are homoclinic points for the hyperbolic periodic point p. 

We remark that the assumption on the flux is crucial. For surface Mg with genus 
g > 2, one can easily construct examples of area preserving flows with exactly 2g — 2 
hyperbolic flxed points and each branch of the stable and unstable manifolds is 
dense in the whole manifold and there is neither homoclinic point nor hcteroclinic 
point. See Figure |21 
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Figure 2. Dense stable and unstable manifolds without homo- 
clinic point. 

We will prove the theorem in a sequence of lemmas. For a positive integer m, let 
^ be a positive real number such that X'^'^S = r]. Let 5 C .D be a region defined by 

Ss = {{x,y)eD\xy<5r], 0<x<r], 0<y<r]} 

Wc use the natural order for the points on and Bg. For any z G i3„, we 
denote the segment of from p to z by i?„[0, z]. We also write i?„ = i?„[0, oo) 
and likewise, B^ = Bg{—oo,0]. Let ui be the smallest point (in other words, the 
first point starting from p) on B^ that re-enters the region Ss- The point ui is on 
the boundary of Sg. Moreover, it enters either from the line {0 < a; < i5, y = 77} or 
from the curve {xy = r]6, S < x < X'^S}. For simplicity, we assume that wi is on 
the line {y = f]}, the other case can be dealt in a similar way. 

For any two points zi,Z2 S D, let l[zi,Z2] be the oriented straight line segment 
from zi to Z2- Obviously B„[0,ui] * Z[wi,0] is an oriented simple closed curve. 
Similarly, wc let zi be the first point on the stable branch Bg that enters Ss- Joining 
two line segment i?s[0,si] and ?[si,0] we also obtain an oriented simple closed 
curve. If our manifold M is 5^, we already see that 5^(0, si) and ^^(O,^!) have 
to intersect, for otherwise we have two contractible simple closed curves -B„[0, ui] * 
l[ui,0] and i?s[0,si] * ^si,0] cross each other only once, at the origin. This is 
impossible. 

For general surfaces, closed curves may not necessarily be contractible. The 
situation is much more complicated, this simple argument no longer work. 

Lemma 4.2. Assume that f € Diff^Q(M) is isotopic to identity and f has zero 
flux. Suppose that the hyperbolic periodic point has no homoclinic point. Then there 

is a sequence of points ui < U2 < < . . . , on Bu such that 

(a) TTy{ui) = r] and < . . . < iTxius) < '!Tx{u2) < i^xiui) < 6, where tTx and Wy 
are projections into respective coordinates; 

(b) The length of the curve Bu[0,Ui\, \Bu[0,Ui\ \ 00 as i 00; and 

(c) The closed curves Bu[0,Ui] * i[wi,0], i G N, are all in the same homotopy 
class. 
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Proof. To simplify the notations, we assume that p is a fixed point, i.e., k = 1. 
The general case with fc > 1 is exactly the same. 

Let s = (0, rj) be the point on the stable manifold Bs and, as in the statement 
of the lemma, ui be the first intersection of Bu in Ss- The curve 



form a simple closed curve. Let si — f{s) — (0, A ^rj) e Bg be the image of s. The 
the image of /i. 



is a closed curve, homotopic to ^i. Moreover, since the flux of / is zero, the signed 
area enclosed by li and f{li) is zero. This implies that the piece of the unstable 
manifold Bu[ui, f{ui)] intersects the line Z[mi,Si] at least at two distinct points. 
There may be, and will be, many points of intersections z such that B[0, z] * /[z, 0] 
is not in the same homotopy class as that of B[0,mi] * /[■ui,0]. But at least two 
distinct points will have this property, since li and f{li) are homotopic. The first 
point ui certainly has this property. Let U2 be the last point on B[ui, f{ui)\ such 
that U2 is on the hue l(ui, s) and B[0, ui] * 0] is homotopic to i3[0, ui] * l[ui, 0]. 
Clearly, M2 ^ ui . A better way to understand the choice of U2 is from the universal 
covering space of surface. The point U2 is simply the last intersection point of the 
proper lifts of li and f{li). The lifts of li are, of course, no longer necessarily closed. 
See Figure 121 



We can now consider the closed curve i3u(0, U2) * ^""2, s] * i?s[s, 0] and its image. 
In the same way, we obtain an intersection point M3. Continue this process, we 
obtain a sequence, mi < 1*2 < W3 < . . ., satisfying the properties of the lemma. 



h = B„(0,ui) * l[ui, s] * l[s,Q\ 




Figure 3. The sequence ui, U2, ■ ■ ■ 



This proves the lemma. 



□ 



Let {ui}, i G N be the sequence from the above lemma. The sequence of real 
numbers {T:x{ui)}, « S N is monotonically decreasing and bounded below by 0, so it 
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converges. It is not obvious that the sequence {wijigN should converge to s in the 
stable manifold. However, we will show that it always does. We have the following 
lemma. 

Lemma 4.3. Let ui < U2 < < . . . , be the sequence of points on the unstable 
manifold given by Lemma \4-S\ Then TTx{ui) as i —> oo. 

The proof of this lemma is quite technical, we postpone it to the next section. 
Here we explain some basic ideas involved in the proof. Suppose that there is curve 
I such that it enters the region Ss twice at different points, as shown in Figure 01 
Further suppose that the curve is invariant in the sense that the segment (abode) 
is mapped to (bcdef). We can join two points on the curve by a horizontal line to 
form a closed curve (abcdefa) as in the figure. Since the curve is invariant, this 
closed curve has nonzero flux, equal to the area of (abfea), which is impossible for 
our map. Suppose the sequence Ui, i € N does not converge to the stable manifold, 
then the limit is in an invariant set formed by taking the limit of pieces of unstable 
manifold. Since the unstable manifold accumulates on the stable manifold, this 
invariant set can get arbitrarily close to the stable manifold. If this invariant set 
is simply a curve, then above argument can derive a contradiction. However, the 
limit set of a sequence of curves can be very complicated, we can not directly apply 
the above argument. But nevertheless, we can only use curves to approximate the 
invariant set, as long as we can control the area lost by the approximation. 




Figure 4. Nonzero flux 



Proof of Theorem 14.11 We are ready to prove the main theorem of this section. 

By Lemma [4.31 there is a sequence of points Ui, i € N on the unstable manifold 
i3„ such that Ui —^ (0,77) and i3„[0,Mi] * ^1(^,0] is in the same homotopy class for 
all I G N. Likewise there is a sequence , i £ N in the stable manifold Bg such that 
Si — > iv^O) and Bs[si,0] * l[0, Si] are in the same homotopy class for all i E N. For 
any e > 0, let 

St = {(x, y) € D \ xy < eri, <x <r], < y < r]} 

We claim that there is point z in Bu such that z E and the closed curve Bu[0, z] * 
l[z,0] is homotopic to the closed curve 

Bu[0,ui] * l[ui,0] * B40, si] * l[si,0]. 
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This can be shown by the foUowing: Let z' be a point in Bs which is close to some 
Si and inside of S^- -Bs[0, 2'] >i=^[z'.0] is homotopic to i3s[0, Si] * [si, 0]. There exists an 
integer j such that P{z') is between the points (0,77) and (0, A"^??) on the stable 
branch Bg. By choosing a different 77, we may just assume that f-'{z') = (0,ry). 
For large i, the pointwi is close to (0,?7), therefore we have that f^{ui) e S^- 
Since i?„[0, Ui] * Z[ui,(0, 77)] * /[(0,ry),0] is homotopic to i?„[0, ui] * Z[mi,0], so is 
/-J(B„[0,u,]*?[M„(0,r;)]*?[(0,r;),0]). This implies that B„[0, 0] 
is homotopic to Bu[Q, ui] * /[ui, 0] * i?s[0, si] * /[si, 0]. We may choose z — f~^{ui). 
This proves the claim. 

In fact, for later convenience, we will choose the point z differently. The tra- 
jectory of f^^{ui) enters the set before f~\ui). We let z be the first point on 
Bu such that z is in the set and Bz[0, z] * l[z, 0] is homotopic to i?z[0, f^^{ui)] * 
l[f~-'{ui)^0]. Obviously, z must be either on the line {0 < x < e, ?/ = 77} or on the 
curve {xy — erj, X^^i] < y < r/}. 

Similarly, there is a point w ^ Bs such that w is the first point in Bs to intersect 
5'e such that the closed curve i?s[0,w] * /[w, 0] is homotopic to the closed curve 
Bs[0,si\ * /[si,0] * i?„[0,ui] * /[7ii,0]. Similarly, w must be either on the line {0 < 
y < e, X = 1]} or on the curve {xy = erj, X~^ri < x < 77}. 

We have obtained two closed curves i?„ [0 , z] * Z [z , 0] and Bs[0,w]*l[w,0]. They are 
not homotopic to each other, but they are homologous to each other, since i?„[0, ui]* 
l[ui, 0] * Bs[0, si] *l[si,0] and Bs[0, si] *l[si,0] * Bu[0, ui] *l[ui,0] are homologous. 
These two curves cross each other at the origin. This crossing at the origin has an 
intersection number ±1. The sign in ±1 depends on the orientation we pick for these 
two curves. There are possibly many other intersection between Bs[0, w]'¥l[w, 0] and 
Bu[0,z] * Z[2;,0]. However, we want to show that all other intersections contribute 
to a total of zero intersection number. Since any tow homologous curves have a 
total of zero intersection number, we reach a contradiction and hence the theorem 
is proved. 

Let zi = z, apply Lemma 14.21 and Lemma 14.31 to the point 21, we obtain a 
sequence of points 2,;, i G N on the line y ~ rj such that the following is true: 

(1) the sequence 2^, i e N is on the unstable branch i?„ and 21 < 22 < 23 < • • • 
with the order on the unstable branch. 

(2) 7r^(2i) > 772,(22) > • • ■ and limi^oo TT^iz^) = 0. 

(3) For any i e N, the closed curve Bu[0, Zi] * l[zi, 0] is homotopic to i?„[0, 2] * 
l[z,0]. 

Similarly, we obtain a sequence of points {wijigN on the stable branch Bs with 
Wi = w. 

For any iq G N, the curve i?u[0, Zi^] is finite and therefore does not intersect with 
l[wi, 0] for sufficiently large i. For small i, the curve Bu[0, Zi^] may have intersection 
with l[wi, 0]. However, the curve l[0, Wi]*Bs[wi,'Wj]*l['Wj,0] is a simply closed curve, 
therefore the total intersection number between Bu[0, Zi^] and l[wi, 0] is zero for any 
i. In other words, the total intersection number between Bu[0, 2] and l[w, 0] is zero. 
Likewise the total intersection number between Bs[0, w] and ^[2, 0]. This shows that 
the total intersection number between Bu[0, z] * l[z, 0] and Bs[0, w] * l[w, 0] is ±1, 
contradicting to the fact that these to curves are homologous. This contradiction 
show that the stable and unstable branches Bs and Bu have to intersect. 

This proves the theorem. 
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5. Proof of Lemma ^31 

In this section, we give a proof of Lemma |4. 31 We will prove by contradiction. 
Suppose on the contrary that Imii^ac T^xiui) = Qx > 0. We write q — {qxiff} — 
limi^oo Ui. 

Let e be a positive real number such that e < qx/'2. and let 

= {{x,y) ^ D \ xy < erj, < x < r/, < y < i]} 

Since the unstable branch Bu accumulates on the stable branch Bg from the first 
quadrant, there is a point vi on _B„ such that vi is the first intersection of B[0,vi] 
with Sc- Again, we assume that vi is on the line {0 < x < 6, y = rj}. The case 
where vi is on the curve {xy = rje, e < x < Xe} can be dealt in a similar way. 

Similar to the choices of the sequence {u^ligpf in Lemma l4.2l we obtain a sequence 
of {vi}i^oo having the same properties as in Lemma 14.21 except of course that 
Bu[0, Vi] * l[vi, 0] is in a different homotopy class as that of i?„[0, Ui] * l[ui, 0]. 

For each Vi, i E N, there is a point u'^ G u'^ g Bu[0, w,] such that 

(1) TTyiu'^) = T] and < 7r^(u-) < n^iui); 

(2) Bu[0, U-] * l[ui, 0] is in the same homotopy class as Bu[0, Ui] * l[ui, 0]; 

(3) the point u'^ is the last such point on Bu[0^ Vi] to have the above properties. 

Again, the choice of u'^ is easy if one looks from the universal covering space. 
See Figure[Sl Finally we choose to be the first point in Bu[u^, Vi] and on the line 
{y = ?7, < a; < e} such that i?u[0, v'j\ * 0] is homotopic to i3u[0, Vi] *l[vi,()\. 




Figure 5. Sequences u- and u-. 



Now we have two sequences of points, {u^}igN and {u^jigN. To simplify our 
notations, we will assume that our original choices of Ui and Vi already satisfy the 
properties for u[ and v[ we have stated. 

We let q' = (q^, ?y) = hm^-^oo Vi. We have < < 7r^(wj), for i e N. 

Now we have a sequence of lines Bu[ui,Vi\, i £ N. Every two consecutive 
lines Bu[ui,Vi] and Bu[ui+i,Vi+i\, together with the line segments l[ui,Ui+i\ and 
l[vi, Vi+i] bound an area. On the universal cover with a fixed lift, the area bounded 
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by these four curves do not have self intersections and it doesn't intersect other 
such areas, except at the boundary. However, when these areas are projected down 
to the manifold, there might be multiple covers at some open sets. Since we will 
use the finiteness of the total area to show certain convergence properties of the 
sequence of the curves Bu[ui,Vi], We need to changes the curves i?„[Mi,Ui+i] so 
that there will be no multiple covers. We will do it in the following way. 

For any i > 1, let Ai be the strip bounded by Bu[ui, Vi], Bu[ui+i,Vi+i], l[ui, Ui+i] 
and l[vi,Vi+i] and let A = UigN^i- We will construct a sequence of new curves di, 
I G N, to replace By[ui. Vi]. In the universal covering space, the strip Ai and the 
set A have infinitely many lifts. Fix one of the lift of Ai, say, Ai. The set Ai may 
intersect other lifts of itself, or lifts of other strips, Aj, j e N in the interior. If 
this does not happen, we will simply let di — Bu[ui,Vi] and (i^+i = 17^+1]. 
Otherwise, we will remove the interior of any part of Ai that intersects with any 
other lift of Ai and any lifts of Aj, j ^ i. 

To understand the structure of the sets removed from Ai, the following fact is 
useful: if any curve Bu[ui,Vi] enters a strip Aj, j ^ i, it has to enter through the 
end of the strips, either through the line segment l[uj,Uj+i] or the line segment 
l[vj,Vj+i]. Moreover, it has to eventually exit through the same segment. This 
is from our construction that By_[ui,Vi] contains no proper segment crossing the 
strips. 

On the manifold, the areas we removed therefore are disks with pieces of bound- 
aries on the line {y = 77, < a; < ui}. We now let di and dj+i be the new boundary 
pieces of Ai. The new boundaries di and di+i are homotopic to, respectively, 
Bu[ui,Vi] and Bu[ui^i,Vi^i], relative to their end points. 

We now have a sequence of curves di, i G N and a sequence of strips Bi on the 
surface, bounded by di, di+i, l[ui,Ui+i] and l[vi,Vi-^-l]. The sequence of strips Bi 
does not intersect each other except at the boundaries. Since the total area of the 
surface is bounded, we conclude that the area of Bi approaches zero, as i — > 00. 
This will be an important fact. 

We now consider the image of di under the map /. Recall that by our assumption, 
limi^oo Mi = q = (qxjV) s-nd luni^ooVi = q = {q'xjV)- Reduce S if necessary, we 
observe that the curves di has to either intersect the line y = Xij or the line y = X~^r], 
right after the point Ui. For definiteness, we may, by choosing a subsequence if 
necessary, assume that all di intersect the line y = X~^ri right after the point 
Ui. With this choice, by the orientation preserving property, di intersects the line 
y = Xr] right before the point Vi. 

Let uj be the intersection point of di with the hne y = A~^ry right after Ui. i.e., 
uj is the first point on Bu[ui, Vi] that is on y = X~^r]. Clearly, /(uj) is on the right 
hand side of uj, but left hand side of This implies that 

lim u] = lim f{ui) = f{q). 

This suggests certain invariance properties of the limit set of the curves Bu[ui, Vi] 
and di. Indeed, let z be a limit point of the curves Bu[ui,Vi]. i.e., there is a 
sequence of the points Zi G Bu[ui, Vi] such that limj^oo Zi = z, then f{zi) is between 
two curves Bu[ui,Vi] and as long as f{zi) stays inside of the strip 

Ai bounded by Bu[ui,Vi], Bu[ut+i,Vi+i], l[ui,Ui+i] and l[vi,Vi+i]. Let z^ be a 
point on the intersection of the line l[f{z), f{zi)] and the curve Bu[ui, Vi], we have 
f{z) = limi_»oo z'i-, i.e., f{z) is also a limit point of the curves Bu[ui,Vi]. 



HOMOCLINIC POINT 



15 



This shows that the hmit set of the sequence of curves Bu[ui,Vi] is forward and 
backward invariant except near the ends of the curves. This hmit set is connected 
and, in general, it is expected to be extremely complicated. In certain sense, this 
limit set starts at q and ends at q', the limit of the sequence Vi. Near these two end 
points, the limit set is quite easy to describe. Between the two points q and f{q), 
this limit set is simply the limit of the curves Bu[ui, uj]. Similarly, between f~^{q') 
and q', this limit set is the limit of the curves Bu[v},Vi], where vj is defined in the 
similar way as uj. 

For any e' > 0, there is a integer lo > such that, if i > iq, the area of the 
strip Bi bounded by di, di+i, l[ui, Uj+i] and l[vi, Vi+i] is smaller than e'. Let Ei be 
the square bounded by Bu[ui,ul], B„[uj+i, wj_,_]^], l[ui,Ui+i] and l[u},ul_^_l] and let 
E = W^iEi. Similarly, let E'^ be the square bounded by Bu[v},Vi], Bu[v}^i,Vi+i], 
l[ui,Ui+i] and l[ul,ul_^_i] and let E' — U°^iEl. By dropping first few terms of the 
sequence Ui and Vi, we may assume that the area of E and E' are both smaller 
than e'. 

Next, we consider the image of Bu[ui^i, fi+i] under / from the universal covering 
space. For most part, the image is in the strip Ai, except near the end point w^+i, 
where it goes out of the strip Ai. The curve di^i is the shortened version of 
By_[ui-^.l,Vi+l], its image are mostly in the strip Bi, bounded by di, di+i, l[ui,Ui+i] 
and l[vi,Vi+i], except near the cut off points, where the image goes out of the strip 
Bi near Vj, j € N. 

Now, we consider the close curve C^+i = rfj+i * l[ui^i,Vi^i]. The image of the 
curve, /(Ci+i) is homologous to Ci+i, together they bound an oriented disk chain, 
say Di+i. i.e., (9-Di+i = f{Ci+i) — Ci+i. By the zero flux property, this disk chain 
has total area zero. We will show that this is impossible, hence a contradiction. 

The disk chain D^+i can be divided into several parts. The first part is inside 
the strip Bi. Let = -Dj+i fli?,, this covers the part of /(C,+i) inside the strip 
Bi. For choices of large i, we have that 



The second part of Z^i+i covers the part of /(Cj+i) near the cut off points of di+i. 
Let = f{E') n i^i+i, where E' is the union of the squares near Vi. We also 
have that 



Let £>f+i be the rest of A+i, i-e., A'+i = A+i\(-D^+i U £>?+i)- The set Z)?+i, 
plus or minus an area of size e', contains the square bounded by Bu[ui^i,u\j^^], 
Bu[f{vl^-^,Vi+i], l[ui+i,f{vl^-y)] and l[u\^-^, f {vi+i)]. Therefore, there is a constant 
m > 0, independent of e' such that if i is large enough. 



This implies that the absolute value of signed area of fj+i is larger than m— 2e' > 0, 
if e' is chosen sufficiently small. This contradicts to the fact that every closed curve 
has zero flux. 






This contradiction proves the lemma. 



□ 
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6. Hamiltonian flows and the proof of the main theorem 
First, we give a proof of Theorem ll.il 

Let T)iS[^ o{M) be the set of area-preserving diffeomorphism on M that are ho- 
motopic to identity and let / e Diff^ o(-^^)- Let p be a hyperbohc periodic point. 
By Lemma f3. II there is /i e Difl^ o(-^^)' close to / such that pi, slighted per- 
turbed from p, is a periodic point for /i with the same period and the flux vector 
for /i is rational. By Lemma f3. 31 there is map /a, C"" close to /2, such that each 
branch of stable manifold and unstable manifold of p2 has a forward or backward 
recurrent point. This implies that for any positive integer fc > 0, the stable and un- 
stable branches accumulate on stable and unstable branches under f^, even though 
the original recurrent point may no longer be recurrent. Moreover, there is an ad- 
jacent pair of stable and unstable branches accumulating on each other. Let k be 
the positive integer such that the flux for /g is zero. By Theorem 14.11 the stable 
and unstable manifolds of p2 under /g intersects and this intersection can be made 
transversal by an arbitrary C small perturbation to f^. This implies that there is 
an open set of diffeomorphisms in Diff^ o(-^)i arbitrarily C"" close to /, such that 
the perturbed periodic point from p has a transversal homoclinic point. Since C 
generically in Difl^ o{M) there are only countably many periodic point, this implies 
that there is a residual set i?i G Diff^ o(-^^) such that for every G Mi and every 
hyperbolic periodic point for (j), there is a homoclinic point. 

This proves Theorem ll.il □ 
To prove Theorem ll.2l we need some preliminary results on Hamiltonian flow. 
Let H : M X ^ R he a time periodic Hamiltonian function on M. Let 

(j) : M xR ^ M , he the Hamiltonian flow on M, given by the C Hamiltonian vector 
field JdH. We write = t). For any to G 5\ let / = 0i : M x {to} 

M X {to} be the Poincare map of the Hamiltonian flow. We will identify M x {to} 
with M in the obvious way and regard / as a map on M . Such map / is called 
Hamiltonian diffeomorphism. Obviously, Hamiltonian diffeomorphisms preserve 
symplectic forms and therefore, on surfaces, they are area-preserving. In fact we 
can say more: All Hamiltonian diffeomorphisms have zero flux. 

Lemma 6.1. Let f be a Hamiltonian diffeomorphism. i.e., f is the time-one map 
of a 1-periodic Hamiltonian flow on compact surface M , then the flux vector for f 
is zero. 

Proof. Let H he & 1-periodic Hamiltonian function on M and let 4)t be its Hamil- 
tonian flow such that f = (pi. Let I be a simple closed curve on M. For any real 
number s > 0, let the set _D C i\/ x M be a flow tube defined by 

D = {{x,t) G Af X M II a; = 0t(xo),O <t<s} 

By the definition of Hamiltonian flow, we have. 




Lu-dH Adt^O 



Where cu is the symplectic form on M. Let ttm{D) be the natural projection of D 
into M. For s small, this projection is in a small neighborhood of the curve /, there 
is, locally, a one- form a such that da = ui. We remark that this one-form is only 



HOMOCLINIC POINT 



17 



defined locally. Such one-form does not exist globally. By Stokes' theorem, we have 

0= uj-dH Adt^ a- H Adt 

Jd J<p^{l)x{s}~lx{0} 



0,(/)x{s}-ix{O} J<ps(l)-l Jt^m(D) 

This is true for any simple closed curve I. One can reach s = 1 in finitely many 
steps. This shows that the flux across / is zero. 

This proves the lemma. □ 

The next question is whether we can perturb the Hamiltonians to create recurrent 
points on the stable and unstable manifolds. This is the same as asking whether the 
perturbation lemma (Lemma 13.2(1 is valid for Hamiltonian diffeomorphisms. This 
is an easy and standard exercise using an flow box along a segment in a giving 
trajectory. We omit the details. 

The proof of Theorem 11.21 now follows from that of Theorem ll.il 
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